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Abstract By introducing a quadratic perturbation to the canonical dual of 
the maxcut problem, we transform the integer programming problem into a 
concave maximization problem over a convex positive domain under some cir- 
cumstances, which can be solved easily by the well-developed optimization 
methods. Considering that there may exist no critical points in the dual fea- 
sible domain, a reduction technique is used gradually to guarantee the fea- 
sibility of the reduced solution, and a compensation technique is utilized to 
strengthen the robustness of the solution. The similar strategy is also applied 
to the maxcut problem with linear perturbation and its hybrid with quadratic 
perturbation. Experimental results demonstrate the effectiveness of the pro- 
posed algorithms when compared with other approaches. 
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1 Introduction 

As one of the 21 NP-hard combinatorial optimization problems pQ, the max- 
cut problem has drawn a great deal of attention for several decades, due to its 
practical applications in circuit layout design, statistical physics, classification, 
and network analysis (for much more, the reader can refer to [2113] )■ 

There are special classes of graphs, for instance, the planar graphs and 
graphs with no K§ minor, for which the maxcut problem can be solvable; 
however, it is impossible to find an algorithm in polynomial time due to its 
NP-hardness in general. Methods to solve the maxcut problem can be classi- 
fied into two categories: direct and indirect. The direct method starts from a 
feasible solution, and then it ameliorates the solution iteratively with various 
strategies. Randomized heuristics which combine a greedy randomized adap- 
tive search procedure, a variable neighborhood search, and a path-relinking 
intensification heuristic in [4] , advanced scatter search in [5] , a variant of spec- 
tral partitioning in [6 , and a new tabu search algorithm in [7] belong to this 
kind. On the other hand, the indirect method focuses on the relaxation of 
the primal or the Lagrangian dual of the maxcut models, and then it uses 
some procedures to make the relaxation solution feasible to orginal problem, 
in which, relaxation means that relaxing some of the constraints and extending 
the objective function to larger space. Based on the semidefinite programming 
(SDP) relaxation, Goemans and Williamson [5] proposed the well-known ran- 
domized approximation algorithm which can achieve a performance guarantee 
of 0.878. Based on the rank-two relaxation, a continuous optimization heuris- 
tic was constructed for approximating the maxcut problem 9 . Based on the 
Lagrangian dual relaxation, smoothing heuristics were presented in |10j . In 
|11) . a polyhedral cut and price approach was investigated to solve the max- 
cut problem, in which, at the pricing phase, an interior point cutting plane 
algorithm was used to solve the Lagrangian dual of the SDP relaxation; at 
the cutting phase, cutting planes based on the polyhedral theory were added 
to the primal problem in order to improve the the SDP relaxation. In |12j . 
a feasible direction method was designed to solve the continuous nonlinear 
programming problem by the relaxed maxcut model. In a branch and bound 
setting, a dynamic bundle method was used to solve the Lagrangian dual of 
the semidefinite maxcut relaxation|13j. 

The canonical dual is a generalized Lagrangian dual, which originated in 
the late 1980s by Gao and Strang, and has developed significantly in recent 
years, which provides a new and potentially useful methodology for solving 
integer programming problems |14|I15] . As shown in [To¥T7] . through special 
canonical dual transformation, the integer programming problems can be con- 
verted to a concave maximization problem over a convex positive domain with- 
out duality gap, which can be solved easily by well-developed optimization 
algorithms under some circumstances. In [IS], a canonical dual approach was 
proposed for the maxcut problem by adding a linear perturbation term to the 
primal objective function; however, the strategy is not so robust to guarantee 
the solution to be located in the primal feasible domain. In this paper, we 
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introduce a quadratic perturbation to the canonical dual of the maxcut prob- 
lem. Furthermore, for some cases when there exist no critical points in the 
dual feasible space, a reduction technique is used gradually to guarantee the 
feasibility of the reduced solution and a compensation technique is utilized to 
strengthen the robustness of the solution. We also apply the strategy to the 
maxcut problem with linear perturbation and its hybrid with quadratic per- 
turbation. Finally, experimental results are given to testify the effectiveness of 
the proposed algorithms. 



2 The Maxcut Problem 

Let G = (V,E) be an undirected graph with edge weight Wij on n + 1 = \V\ 
vertices and m = \E\ edges, for each edge G E, the maxcut problem is 
to find a subset S of the vertex set V such that the total weight of the edges 
between S and its complementary subset S — V\S is as large as possible. 



2.1 LP based maxcut model 

Considering a variable yij for each edge G E, and assuming y^ to be 1 
if is in the cut, and otherwise, the maxcut problem can be modeled as 
the following linear programming (LP) optimization problem: 



Here the incidence vector y = {y%j} G R m , where the m is the number of edges 
in the graph. 

Let CUT(G) denote the convex hull of the incidence vectors of cuts in G. 
Since maximizing a linear function over a set of points equals to maximizing 
it over the convex hull of this set of points, we can rewrite (JTJ) to the following 
form: 



n+l 




i=l i<j,(i,j)eB 

y is the incidence vector of a cut. 



s.t. 



(1) 



max W(y) = c T y 

s.t. y e CUT(G). 



(2) 



where c = {ro,,} G K' 



2.2 SDP based maxcut model 



For a bipartition (S,S), with ?/,• = 1 if i G S, and yi = —1 otherwise, the 
maxcut problem can be formulated as the following semidefinite programming 
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optimization problem: 

_^ n+l n+1 

max W(y) = ^J2Y1 Wi ^ 1 ~ 

s.t. ye{-Mr +1 , (3) 

Without loss of generality, if we fix the value of the last variable at 1, then 
the problem Q is equivalent to the following form (primal problem): 

(V) : min{p(x) = i(x,Qx) - (x,c) : x e {-1,1}"}, (4) 

where, (u, u) = u T u denotes the bilinear form, Q is a symmetric matrix with 
Qij = Wij(i,j = 1,2,--- ,n), and c = -(iw 1( „ +1 ), • • ■ ,w„ (n+1) ) T . It is not 
difficult to find that a optimal solution x* to problem (U|) corresponds to a 
optimal solution (x*, 1) of original problem 

The canonical dual algorithms in this paper are based on the SDP model. 



3 Primal problem with linear perturbation 

In [18], a linear non-zero vector Ac = (Aci, • • • , Ac„) g R™ is added to the 
primal problem and then we can get the linearly perturbed problem 

{Vi) : min |p(x) = i(x, Qx) - (x, c + Ac) : x e {-1, 1}"}. (5) 

It proved that, if Y^i=x < 1' the perturbed optimal solution is equiv- 
alent to the solution of primal problem, and if J27=i l^ c i| = QtW(x), where 
x is the optimal solution of the perturbed problem and a > is a constant, 
then W(x) > y^jVF*, here, W* is the optimal value of the primal problem. 

The problem of this linear perturbation is that, for one thing, it is not easy 
to find such an appropriate perturbation, and for another, if X^™=i l^ c *l > 1j 
only approximate solution can be obtained. 



4 Canonical dual problem with quadratic perturbation 

We give the notations sot := [sit±, ■ ■ ■ , s m t m ] and s0t :— [s\/t\, ■ • • , s m /t m ] 
to denote the Hadamard product and quotient for any two vector s,t £ R m , 
Diag{u) to represent a diagonal matrix with components of the vector v as 
its elements, and e to stand for a vector of all ones. 

By the fact x o x = e and [x o x] T ot = x T Diag(a.)x = e T a, then the 
problem (V) is identical to the following a— perturbed problem: 



(V a ) :min{p Q (x) - -{x, (Q + Diag(a.))x) - {x, c) - d a |x 6 {-1, 1}™}, (6) 
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where d a — i(e, a), ct G M. n is a parametrical vector. 
Introducing a quadratic geometrical operator 

e = A(x) = -(xox-e) (7) 

and following the standard procedures of canonical dual methodology, the 
a— perturbed canonical dual problem is obtained as follows 

{V d a ) : max{P Q V) = -\{G-\a)o,c) - \{e,*)-d a \a G 5+}, (8) 

where, G a (cr) = Q + Diag(a + er), and 

S+ = {<r G R"|G Q (o-) >- 0}. (9) 

Further more, a quadratic penalty term is added to the a— perturbed 
canonical dual problem, and then we get the (3— perturbed canonical dual 
problem 

i 1 - 2 

(7^) : maxjP^H = --{G~\a) C , c)- - J^+^-d^ G (10) 

Theorem 1 Suppose that for a given perturbation vector a such that Q + 
Diag(a) -< 0, and ft 3> 0(i = 1,2, ■•• , n) is &ig enough, if <x G 5„ is a 
critical point of the j3— perturbed canonical dual problem, then 

x = (tr)c, x* = round(x), (11) 

x* is a global solution to the (V). 

Proof First, we prove that x* defined by (lTTj) is feasible of (V). 
Considering that 

gg^) = l d[c T G-»c] a, 1 
<9cr, 2 <9cr,- ft 2 

- 2 C G « (<T) ^T G " (<T)C "A "2 

1,_ _x °i 1 

= —(xox),- 

2 V " ft 2 

- I" 2 _ __ _ I 

" 2^ " ft ~ 2' 

if o- is a critical point of (P^p), then |sf — ~ 5 = 0; namely, if = + 1. 

If ft 3> is big enough, it is easy to find that x* — round(xi) — ±1, which 
is a feasible solution to (V). 

Then, we prove that x* is a global solution. 

By the fact that Q + Diag(ot) -< 0, we can conclude that er > due to 
G a {(r) >- 0. Therefore, the /3— perturbed canonical dual problem (P^g) is 
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strictly concave on <S+ , and if the critical point a £ <S+ , it must be a unique 
maximizer of problem (V^a). Consequently, the corresponding x* defined by 
(|f f P must be unique. On the other hand, we have 

P a (x) = i(x, (Q + Diag(a))5c) - (x,c) - d a 

= i (x, G a (ct)x) - (x, c) - - (ct, e) - d a 

= min ~(x, Gq(o-)x) - (x, c) - ~{d-,e) - d Q 

< min t:(x, (Q + Diag(a))x) — (x, c) — d a , 

x£{-l : l}' 1 2 

that is to say, x* = round(5c) is the global solution of (V a ) and so the global 
solution of (V). 

5 Canonical dual algorithms 

Now, we present a gradient-based iterative method for the ft— perturbed 
canonical dual problem. 

It is not difficult to find that the search direction (negative gradient) of the 
negative canonical dual function —P^Jer) is 

d= ixox-cr0/3 - -e, (12) 

and step size of each component of search direction is obtained by a golden 
section search technique from [0,a max ], where a max is determined by making 
the corresponding diagonal component of G a (cr) positive. 

We use three types of termination criteria to stop the procedure. The details 
of the algorithm is give in the following 



Algorithm 1 

1: Initialization, set = <r u , a, f3, e and k = 
2: while (1) do 

3: xj, «- (Q + Diag(a + a k ))~ 1 c, d fe <- ^x fe o x fc - a k f3 - |e 

4: = a k + a k X d k 

5: x fc+1 <- (Q + Diag(a + <r fc+1 ))- 1 c 

6: if lldfell < e or || Xfc+1 " Xfc || < e or W "^ 1 ~" k II < e then 

II K|| _ || Xfc || _ M ^ || _ 

7: x* round(x k +i), break 
8: end if 
9: k <r- k + 1 
10: end while 



where, e is the numerical precision, and the initial point <r° should make 
G a (<r°) positive. 

Remark 1 If the final critical point <x* of (P„o) is in <S+, according to Theorem 
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1, we can conclude that the corresponding x* is the global solution to (V). 

However, the critical point cr* is not always in S£ , or in 5+ , we can not 
find a critical point cr*. In this case, we can find that some components of 
x* are feasible, and other components are infeasible. Thus, there must exist a 
transformation N £ R™ xm , such that 

x*= Xp + Nx h , (13) 

where, x p G R" is the particular solution with infeasible components zeros, 
and x/i € M." 1 is called the reduced solution. 
Considering that 

P(x*) =P(x p + N Xh ) 

= ~(x p + Nx h ) T Q(x p + Nx h ) - c T (x p + Nx h ) 

= ^%{N T QN)x h - *l(N T c - N T Qx p ) + ixjQx p - c T x p , (14) 

as a result, we have to solve the reduced problem in further 

P(x ft ) = ^(xft.QfeXft) - (xh,c h ), (15) 

where, Q h = N T QN, c h = N T c ~ iV T Qx p . 

The reduction technique above can be regarded as "greedy criterion" , which 
belongs to local search to some extent. To compensate for the lost information 
in the reduction process, we use a simple compensation technique, that is, 
replacing each binary component in x* with its counterpart, to strength the 
robustness of the solution. The details of the improved canonical dual algo- 
rithm are given below: 



Algorithm CDA1 

1: Using Algorithm 1 as a subroutine to get x* 
2: if the corresponding a* ^ Sa then 
3: obtaining current x^, by the reduction technique 
4: while length(x/ l ) > 1 do 

5: solving the current reduced problem P(x^) by Algorithm 1 again 
6: if the corresponding <r£ £ a(M then 
7: x* = x p + Wxj , break 

8: else 

9: obtaining current Xf, by the reduction technique again 

10: end if 
11: end while 
12: end if 

13: Using the compensation technique to strength the robustness of the solution 



We also apply the similar reduction technique and compensation technique 
to the maxcut problem with linear perturbation in |18j and its hybrid with 
quadratic perturbation in this paper, so we get the corresponding algorithms 
named CDA2 and CD A3. 
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6 Experimental results 

To testify the effectiveness of the proposed algorithms, firstly, we give a ran- 
dom example to show that in some case, the Algorithm 1 can achieve a global 
solution without additional strategies. Then we compared our algorithms with 
other approaches for some published TSPLIB (see in [5D]) instances results. 
Finally, some large instances in TSPLIB are tested to show the capacity of our 
algorithms. We run the proposed procedures in MATLAB R2010b on Intel(R) 
Core(TM) i3-2310M CPU @2.10GHz under Window 7 environment. 

Example 1 Consider the following 10-dimensional problem(n=9) with ran- 
domly selected matrix Q and c, a and (3 



/0 6484556 8\ 




( 2 \ 




/-17.3208\ 




/605.7162\ 


603945587 




5 




-2.8050 




601.1675 


430624754 




3 




-36.5410 




330.2360 


896074766 




5 




-1.1174 




277.4284 


442707546 


,c = 


2 


,a = 


-38.3706 


,13 = 


674.9582 


554470027 




5 




-77.0470 




540.0750 


557750045 




4 




-20.1651 




537.7345 


685642402 




5 




-31.3002 




690.3018 


\8 7466752 0/ 




\v 




^-34.9461/ 




1^371.8627/ 



we can get the dual critical solution 

<t* = (34.0286, 19.9327, 50.1747, 12.6699, 55.9428, 88.7105, 30.2908, 45.0242, 45.6742) T , 
and the corresponding 

x* = roundiG^i^c) = (1, 1, 1, -1, 1, -1, -1, -1, -1). 

We can check that er* is in the dual feasible domain <S+, that is to say, the 
corresponding x* is the global solution according to Theorem 1. 

Example 2 We compare our algorithms with the published results found 
in [E^GW^) and 0[19] (circut). From Table [TJ we find that all of the canonical 
dual algorithms can achieve the same or better solutions than that of (circut) 
and (GW), with comparable shorter time. 



Table 1 Comparison with other algorithms for medium-size TSPLIB instances 



Instances 


circut 


time 


GW 


time 


CDA1 


time 


CD A 2 


time 


CD A 3 


time 


burmal4 


283 


0.046 






283 


0.216 


283 


0.084 


283 


0.095 


grl7 


24986 


0.047 






24986 


0.087 


24986 


0.272 


24986 


0.189 


bays29 


53990 


1.109 






53990 


0.349 


53990 


0.159 


53990 


0.152 


dantzig42 


42638 


1.75 


42638 


43.35 


42638 


0.540 


42638 


0.204 


42638 


0.203 


gr48 


320277 


3.672 


320277 


26.17 


320277 


0.346 


320277 


0.287 


320277 


0.294 


hk48 


771712 


2.516 


771712 


66.52 


771712 


1.368 


771712 


0.426 


771712 


0.510 


gr96 


105328 


14.250 


105295 


531.50 


105328 


0.550 


105328 


0.975 


105328 


0.693 


kroAlOO 


5897368 


2.359 


5897392 


420.83 


5897392 


1.444 


5897392 


1.053 


5897392 


0.785 


kroBlOO 


5763020 


2.531 


5763047 


917.47 


5763047 


1.440 


5763047 


1.021 


5763047 


0.890 


kroClOO 


5890745 


2.500 


5890760 


398.78 


5890760 


1.258 


5890760 


0.986 


5890760 


0.898 


kroDlOO 


5463250 


2.547 


5463250 


469.48 


5463250 


1.571 


5463250 


1.115 


5463250 


0.843 


kroElOO 


5986587 


2.500 


5986591 


375.68 


5986591 


1.476 


5986591 


1.476 


5986591 


0.888 


gr!20 






2156667 


754.87 


2156667 


2.752 


2156667 


1.978 


2156667 


1.358 
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Example 3 Other instances from TSPLIB are used to test the capacity of 
the proposed algorithms, and we test the size of the instances up to 500 with 
no more than 2 minutes. In the meanwhile, we use a toolbox called YALMIP 
[2Tj to solve the same problems for comparison. The results also show the dif- 
ferent performance of the three canonical dual algorithms (CDA3> CDA1> 
CDA2), which indicate that the hybrid with linear and quadratic perturbation 
is a better choice, especially for gil262. 



Table 2 Comparison with YALMIP for large-size TSPLIB instances 



Instances 


YALMIP 


time 


CDA1 


time 


CD A 2 


time 


CD A3 


time 


chl30 


1888108 


3.448 


1888108 


3.036 


1888108 


2.608 


1888108 


1.461 


chl50 


2525606 


4.007 


2525626 


3.767 


2525626 


3.400 


2525626 


1.671 


dl98 


12938532 


6.910 


12938532 


9.256 


12938532 


16.725 


12938532 


3.790 


gr202 


195433 


6.980 


197098 


7.600 


197098 


8.196 


197098 


4.866 


gr229 


1203249 


9.463 


1205180 


9.513 


1205180 


7.697 


1205180 


8.576 


gil262 


2131227 


13.360 


2149623 


10.479 


2147693 


10.352 


2152173* 


6.892 


pr299 


80047271 


20.156 


80324674 


34.453 


80324674 


19.710 


80324674 


14.165 


lin318 


59504077 


24.221 


59547803 


17.888 


59547803 


33.739 


59547803 


13.158 


H417 


76742924 


61.888 


76776296 


28.738 


76776296 


40.181 


76776296 


22.590 


pr439 


277700818 


73.775 


278552199 


46.210 


278552199 


55.039 


278552199 


37.913 


d493 


75651106 


99.701 


75740087 


53.323 


75740087 


66.291 


75740087 


45.986 


att532 


281648797 


127.485 


287417240 


57.681 


287417240 


109.979 


287417240 


52.192 



7 Conclusion 

In this paper, we have studied the maxcut problem with a quadratic pertur- 
bation term added to the canonical dual problem. A gradient-based algorithm 
is designed to solve the quadratic perturbed canonical dual problem. For some 
cases with no critical points in the dual feasible domain, a reduction technique 
and a compensation technique are introduced to improve the quality of the 
solution. The similar techniques are also applied to maxcut model with linear 
perturbation and its hybrid with quadratic perturbation. Numerical results 
show that the proposed algorithms are effective in terms of both time com- 
plexity and the solution quality, in the same time, it indicates that the hybrid 
perturbation is a more promising approach. 
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